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(57) Abstract: Provided is an architecture for a cryptography accelerator chip that allows significant performance improvements 
over previous prior art designs. In various embodiments, the architecture enables parallel processing of packets through a plurality 
of cryptography engines and includes a classification engine configured to efficiently process encryption/decryption of data packets. 
Cryptography acceleration chips in accordance may be incorporated on network line cards or service modules and used in applica- 
tions as diverse as connecting a single computer to a WAN, to large corporate networks, to networks servicing wide geographic areas 
(e.g.. cities). The present invention provides improved performance over the prior an designs, with much reduced local memory 
requirements, in some cases requiring no additional external memory. In some embodiments, the present invention enables sustained 
full duplex Gigabit rate security processing of IPSec protocol data packets. 
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Distributed Processing in a Cryptography 
Acceleration Chip 



BACKGROUND OF THE INVENTION 

5 The present invention relates generally to the field of cryptography, and more 

particularly to an architecture and method for cryptography acceleration. 

Many methods to perform cryptography are well known in the art and are 
discussed, for example, in Applied Cryptography . Bruce Schneier, John Wiley & 
Sons, Inc. (1996, 2 nd Edition), herein incorporated by reference. In order to improve 

10 the speed of cryptography processing, specialized cryptography accelerator chips have 
been developed. For example, the Hi/fa ™ 7751 and the VLSI ™ VMS115 chips 
provide hardware cryptography acceleration that out-performs similar software 
implementations. Cryptography accelerator chips may be included in routers or 
gateways, for example, in order to provide automatic IP packet encryption/decryption. 

15 By embedding cryptography functionality in network hardware, both system 
performance and data security are enhanced. 

However, these chips require sizeable external attached memory in order to 
operate. The VLSI VMS115 chip, in fact, requires attached synchronous SRAM, 
which is the most expensive type of memory. The substantial additional memory 
20 requirements make these solutions unacceptable in terms of cost versus performance 
for many applications. 

Also, the actual sustained performance of these chips is much less than peak 
throughput that the internal cryptography engines (or "crypto engines") can sustain. 
One reason for this is that the chips have a long "context" change time. In other 

25 words, if the cryptography keys and associated data need to be changed on a packet- 
by-packet basis, the prior art chips must swap out the current context and load a new 
context, which reduces the throughput. The new context must generally be externally 
loaded from software, and for many applications, such as routers and gateways that 
aggregate bandwidth from multiple connections, changing contexts is a very frequent 

30 task. 

Moreover, the architecture of prior art chips does not allow for the processing 
of cryptographic data at rates sustainable by the network infrastructure in connection 
with which these chips are generally implemented. This can result in noticeable 
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delays when cryptographic functions are invoked, for example, in e-commerce 
transactions. 

Recently, an industry security standard has, been proposed that combines both 
"DES/3DES" encryption with "MD5/SHA1" authentication, and is known as "IPSec " 
By incorporating both encryption and authentication functionality in a single 
accelerator chip, over-all system performance can be. enhanced. But due to the 
limitations noted above, the prior art solutions do not provide adequate performance at 
a reasonable cost. 

Thus it would be desirable to have a cryptography accelerator chip architecture 
that is capable of implementing the IPSec specification (or any other cryptography 
standard), at much faster rates than are achievable with current chip designs. 
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I SUMMARY OF THE INVENTION 

In general, the present invention provides an architecture for a cryptography 
accelerator chip that allows significant performance im^bvements over previous prior 
art designs. In various embodiments, the architecture enables parallel processing of 
5 packets through a plurality of cryptograpKy~engmes and includes a classification 
engine configured to efficiently process encryption/decryption of data packets. 
Cryptography acceleration chips in accordance may be incorporated on network line 
cards or service modules and used in applications as diverse as connecting a single 
computer to a WAN, to large corporate networks, to networks servicing wide 
10 geographic areas (e.g., cities). The present invention provides improved performance 
I over the prior art designs, with much reduced local memory requirements, in some 

cases requiring no additional external memory. In some embodiments, the present 
; invention enables sustained full duplex Gigabit rate security processing of BPSec 

protocol data packets. 

15 In one aspect, the present invention provides a cryptography acceleration chip. 

The chip includes a plurality of cryptography processing engines, and a packet 
distributor unit. The packet distributor unit is configured to receive data packets and 

* matching classification information for the packets, and to input each of the packets to 

one of the cryptography processing engines. The combination of the distributor unit 

1 20 and cryptography engines is configured to provide for cryptographic processing of a 

plurality of the packets from a given packet flow in parallel while maintaining per 
flow packet order. In another embodiment, the distributor unit and cryptography 
engines are configured to provide for cryptographic processing of a plurality of the 
packets from a plurality of packet flows in parallel while maintaining packet ordering 
25 across the plurality of flows. 

! In another aspect, the invention provides a method for accelerating 

: cryptography processing of data packets. The method involves receiving data packets 

] on a cryptography acceleration chip, processing the data packets and matching 

classification information for the packets, and distributing the data packets to a 
30 plurality of cryptography processing engines for cryptographic processing. The data 
packets are cryptographically processed in parallel on the cryptography processing 
engines, and the cryptographically processed data packets are output from the chip in 
correct per flow packet order. In another embodiment the combination of the 
distribution and cryptographic processing further maintains packet ordering across a 
35 plurality of flows. 

: -3 - 
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These and other features and advantages of the present invention will be 
presented in more detail in the following specification of the invention and the 
accompanying figures which illustrate by way of example the principles of the 
! invention. 

5 BRIEF DESCRIPTION OF THE DRAWINGS 

: The present invention will be readily understood by the following detailed 

description in conjunction with the accompanying drawings, wherein like reference 
numerals designate like structural elements, and in which: 

I Figs. 1A and B are high-level block diagrams of systems implementing a 

5 '0 cryptography accelerator chip in accordance with one embodiment the present 

invention. 

Fig 2 is a high-level block diagram of a cryptography accelerator chip in 
accordance wiih one embodiment the present invention. 

Fig. 3 is a block diagram of a cryptography accelerator chip architecture in 
CQrdmccj»ith_one_embo diment of the present invention. 



Fig. 4 is a block diagram illustrating a DRAM-based or SRAM-based packet 
classifier in accordance with one embodiment the present invention. 

Fig. 5 is a block diagram illustrating a CAM-based packet classifier in 
accordance with one embodiment the present invention., 

20 Figs. OA and 6B are flowcharts illustrating aspects of inbound and outbound 

packet processing in accordance with one embodiment the present invention. 

Fig. 7 shows a block diagram of a classification engine in accordance with one 
embodiment of the present invention, illustrating its structure and key elements. 
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DETAILED DESCRIPTION OF THE INVENTION 

Reference will now be made in detail to some specific embodiments of the 
invention including the best modes contemplated by the inventors for carrying out the 
invention. Examples of these specific embodiments are illustrated in the 

5 accompanying drawings. While the invention is described in conjunction with these 
specific embodiments, it will be understood that it is not intended to limit the 
invention to the described embodiments. On the contrary, it is intended to cover 
alternatives, modifications, and equivalents as may be included within the spirit and 
scope of the invention as defined by the appended claims. In the following 

10 description, numerous specific details are set forth in order, to provide a thorough 
understanding of the present invention. The present invention may be practiced 
without some or all of these specific details. In other instances, well known process 
operations have not been described in detail in order not to unnecessarily obscure the 
present invention. 

15 In general, the present invention provides an architecture for a cryptography 

accelerator chip that allows significant performance improvements over previous prior 
art designs. In preferred embodiments, the chip architecture enables "cell-based" 
processing of random-length IP packets, as described in copending U.S. Patent 
Application No. 09/510,486, entitled Security CHIP ARCHITECTURE AND 

20 Implementations for Cryptography Acceleration, incorporated by reference 
herein in its entirety for all purposes. Briefly, cell-based packet processing involves 
the splitting of IP packets, which may be of variable and unknown size, into smaller 
fixed-size "cells." The fixed-sized cells are then processed and reassembled 
(recombined) into packets. The cell-based packet processing architecture of the 

25 present invention allows the implementation of a processing pipeline that has known 
processing throughput and timing characteristics, thus making it possible to fetch and 
process the cells in a predictable time frame. In preferred embodiments, the cells may 
be fetched ahead of time (pre-fetched) and the pipeline may be staged in such a 
manner that the need for attached (local) memory to store packet data or control 

30 parameters is minimized or eliminated. 

Moreover, in various embodiments, the architecture enables parallel 
processing of packets through a plurality of cryptography engines, for example four, 
and includes a classification engine configured to efficiently process 
encryption/decryption of data packets. Cryptography acceleration chips in accordance 
35 may be incorporated on network line cards or service modules and used in 
applications as diverse as connecting a single computer to a WAN, to large corporate 

-5- 
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networks, to networks servicing wide geographic areas (e.g., cities). The present 
invention provides improved performance over the prior art designs, with much 
reduced local memory requirements, in some cases requiring no additional external 
memory. In some embodiments, the present invention enables sustained full duplex 
5 Gigabit rate security processing of IPSec protocol data packets. 

In this specification and the appended claims, the singular forms "a," "an,** and 
41 the M include plural reference unless- the context clearly dictates otherwise. Unless 
defined otherwise, all technical and scientific terms used herein have the same 
meaning as commonly understood to one of ordinary skill in the art to which this 
10 invention belongs. . 

The present invention may be implemented in a variety of ways. Figs. 1 A an 
IB illustrate two examples of implementations of the invention as a cryptography 
acceleration chip incorporated into a network line card or a system module, 
respectively, in a standard processing system in iaccordance with embodiments of the 
15 present invention. 

As shown in Fig. 1 A, the cryptography acceleration chip 102 may be part of an 
otherwise standard network line card 103 which includes a WXNTinterface lT2~that 
connects the processing system 100 to a WAN, such as the Internet, and manages in- 
bound and out-bound packets. The chip 102 on the card 103 may be connected to a 
20 system bus 104 via a standard system interface 106. The system bus 104 may be, for 
example, as standard PCI bus, or it may be a high speed system switching matrix, as 
are well known to those of skill in the art. The processing system 100 includes a 
processing unit 114, which may be one or more processing units, and a system 
memory. unit 116. . 

25 The cryptography acceleration chip 102 on the card 103 also has associated 

with it a local processing unit 108 and local memory 110. As will be described in 
more detail below, the local memory 110 may be RAM or CAM and may be either on 
or off the chip 102. The system also generally includes a LAN interface (not shown) 
which attaches the processing system 100 to a local area network and receives packets 

30 for processing and writes out processed packets to the network- 
According to this configuration, packets are received from the LAN or WAN 
and go directly through the cryptography acceleration chip and are processed as they 
are received from or are about to be sent out on the WAN, providing automatic 
security processing for DP packets. 

-6- 
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In some preferred embodiments the chip features a streamlined IP packet- 
in/packet-but interface that matches line card requirements in ideal fashion. As 
■ described further below, chips in accordance with the present invention may provide 

distributed processing intelligence that scales as more line cards are added, 
5 automatically matching up security processing power with overall system bandwidth. 
In addition, integrating the chip onto line cards preserves precious switching fabric 
bandwidth by pushing security processing to the edge of the system. In this way, since 
the chip is highly autonomous, shared system CPU resources are conserved for 
; switching, routing and other core functions. 

i 

10 One beneficial system-level solution for high-end Web switches and routers is 

\ to integrate a chip in accordance with the present invention functionality with a 

gigabit Ethernet MAC and PHY. The next generation of firewalls being designed 
today require sustained security bandwidths in the gigabit range. Chips in accordance 
with the present invention can deliver sustained full duplex multi-gigabit IPSec 

15 processing performance. 

i 

As shown in Fig, IB, the cryptography acceleration chip 152 may be part of a 
service module 153, for cryptography acceleration. The chip 152 in the service 
5 module 153 may be connected to a system bus 154 via a standard system interface 

\ 156. The system bus 154 may be, for example, a high speed system switching matrix, 

\ 20 as are well known to those of skill in the art. The processing system 150 includes a 

\ processing unit 164, which may be one or more processing units, and a system 

memory unit 166. 

The cryptography acceleration chip 152 in the service module 153 also has 
associated with it a local processing unit 158 and local memory 160. As will be 

j 25 described in more detail below, the local memory 160 may be RAM or CAM and may 

be either on or off the chip 152. The system also generally includes a LAN interface 

: which attaches the processing system 150 to a local area network and receives packets 

for processing and writes out processed packets to the network, and a WAN interface 
that connects the processing system 150 to a WAN, such as the Internet, and manages 
30 in-bound and out-bound packets. The LAN and WAN interfaces are generally 
provided via one or more line cards 168, 170. The number of line cards will vary 

; depending on the size of the system. For very large systems, there may be thirty to 

forty or more line cards. 

According to this configuration, packets received from the LAN or WAN are 
35 directed by the high speed switching matrix 154 to memory 166, from which they are 
; sent to the chip 152 on the service module 153 for security processing. The processed 

i 

i 
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packets are then sent back over the matrix 154, through the memory 166, and out to 
the LAN or WAN, as appropriate. 

Basic Features. Architecture and Distributed Processing 

Fig. 2 is a high-level block diagram of a cryptography chip architecture in 
5 accordance with one embodiment of the present invention. The chip 200 may be 
connected to external systems by a standard PCI interface (not shown), for example a 
; 32-bit bus operating at up to 33 MHz. Of course, other interfaces and configurations 

may be used, as is well known in the art, without departing from the scope of the 
present invention. 

4 

I 10 Referring to Fig. 2, the IP packets are read into a FIFO (First In First Out 

buffer) input unit 202. This interface (and the chip's output FIFO) allow packet data 
to stream into and out of the chip. In one embodiment, they provide high performance 
FIFO style ports that are unidirectional, one for input and one for output. In addition, 
the FIFO 202 supports a bypass capability that feeds classification information along 
15 with packet data. Suitable FIFO-style interfaces include GMII as well as POS-PHY-3 

style FIFO based interfaces, well known to those skilled in the art. 

3 • From the input FIFO 202, packet header information is sent to a packet 

; classifier unit 204 where a classification engine rapidly determines security 

association information required for processing' the packet, such as encryption keys, 
! 20 data, etc. As described in further detail below with reference to Figs. 4, 5 and 6A and 

B, the classification engine performs lookups from databases stored in associated 
memory. The memory may be random access memory (RAM), for example, DRAM 
or SSRAM, in which case the chip includes a memory controller 212 to control the 
j associated RAM. The associated memory may also be contact addressable memory 

5 25 (CAM), in which case the memory is connected directly with the cryptography 

engines 216 and packet classifier 204, and a memory controller is unnecessary. The 
associated memory may be on or off chip memory. The security association 
information determined by the packet classifier unit 204 is sent to a packet distributor 
unit 206. 

30 The distributor unit 206 determines if a packet is ready for IPSec processing, 

and if so, distributes the security association information (SA) received from the 
packet classifier unit 204 and the packet data among a plurality of cryptography 
processing engines 124, in this case four, on the chip 200, for security processing. 
This operation is described in more detail below. 

-8- 
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The cryptography engines may include, for example, "3DES-CBC/DES X" 
enciyption/decryption "MD5/SHA1" authentication/digital signature processing and 
compression/decompression processing. It should be noted, however, that the present 
architecture is independent of the types of cryptography processing performed, and 
5 additional cryptography engines may be incorporated to support other current or future 
cryptography algorithms. Thus, a further discussion of the cryptography engines is 
beyond to scope of this disclosure. 

Once the distributor unit 206 has determined that a packet is ready for EPSec 
processing, it will update shared IPSec per-flow data for that packet, then pass the 
10 packet along to one of the four cryptography and authentication engines 214. The 
\ distributor 206 selects the next free engine in round-robin fashion within a given flow. 

Engine output is also read in the same round-robin order. Since packets are retired in 
a round-robin fashion that matches their order of issue packet ordering is always 
maintained within a flow ("per flow ordering"). For the per-flow ordering case, state 
15 is maintained to mark the oldest engine (first one issued) for each flow on the output 
j side, and the newest (most recently issued) engine on the input side; this state is used 

to select an engine for packet issue and packet retiring. The chip has an engine 
scheduling module which allows new packets to be issued even as previous packets 
3 from the same flow are still being processed by one or more engines. In this scenario, 

: 20 the SA Buffers will indicate a hit (SA auxiliary structure already on-chip), shared state 

>■ will be updated in the on-chip copy of the SA auxiliary structure, and. the next free 

engine found in round-robin order will start packet processing. 

Thus, the distributor 206 performs sequential portions of IPSec processing that 
rely upon packet-to-packet ordering, and hands off a parallelizable portion of IPSec to 
25 the protocol and cryptography processing engines. By providing multiple 
| cryptography engines and processing data packets in parallel chips in accordance with 

] the present invention are able to provide greatly improved security processing 

; performance. The distributor also handles state cleanup functions needed to properly 

retire a packet (including ensure that packet ordering is maintained) once IPSec 
30 processing has completed. 

Per-flow ordering offers a good trade-off between maximizing end-to-end 
system performance (specifically desktop PC TCP/IP stacks), high overall efficiency, 
and design simplicity. In particular, scenarios that involve a mix of different types of 
traffic such as voice-over-IP (VoIP), bulk ftp/e-mail, and interactive telnet or web 
35 browsing will run close to 100% efficiency Splitting, if necessary, a single IPSec 

-9- 
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tunnel into multiple tunnels that cany unrelated data can further enhance processing 
efficiency, 

. Per-flow EPSec data includes IPSec sequence numbers, anti-replay detection 
masks, statistics, as well as key lifetime statistics (time-based and byte-based 
5 counters). Note that some of this state cannot be updated until downstream 
cryptography and authentication engines have processed an entire packet. An example 
of this is the anti-replay mask, which can only be updated once a packet has been 
established as a valid, authenticated packet. In one embodiment, the distributor 206 
handles these situations by holding up to eight copies of per-flow IPSec information 
10 on-chip* one copy per packet that is in process in downstream authentication and 
crypto engines (each engine holds up to two packets due to internal pipelining). These 
copies are updated once corresponding packets complete processing. 

This scheme will always maintain ordering among EPSec packets that belong 
to a given flow, and will correctly process packets under all possible completion 
1 5 ordering scenarios. 

In addition, in some embodiments, a global flag allows absolute round robin 



sequencing, which maintains packet ordering even among different flows ("strong 
ordering"). Strong ordering may be maintained in a number of ways, for example, by 
assigning a new packet to the next free cryptography processing unit in strict round- 

20 robin sequence. Packets are retired in the . same sequence as units complete 
processing, thus ensuring order maintenance. If the next engine in round-robin 
sequence is busy, the process of issuing new packets to engines is stalled until the 
engines become free. Similarly, if the next engine on output is not ready, the packet 
output process stalls. These restrictions ensure that an engine is never "skipped", thus 

25 guaranteeing ordering at the expense of some reduced processing efficiency. 

Alternatively, strong ordering may be maintained by combining the distributor 
unit with an order maintenance packet retirement unit. . For every new packet, the 
distributor completes the, sequential portions of IPSec processing, and assigns the 
packet to the next free engine. Once the engine completes processing the packet, the 

30 processed packet is placed in a retirement buffer. The retirement unit then extracts 
processed packets out of the retirement buffer in the same order that the chip 
originally received the packets, and outputs the processed packets. Note that packets 
may process through the multiple cryptography engines in out of order fashion; 
however, packets are always output from the chip in the same order that the chip 

35 received them. This is an "out-of-order execution, in-order retirement" scheme. The 

-10- 
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scheme maintains peak processing efficiency under a wide variety of workloads, 
including a mix of similar size or vastly different size packets. 

Most functions of the distributor are performed via dedicated hardware assist 
logic as opposed to microcode, since the distributor 206 is directly in the critical path 
5 of per-packet processing. The distributor's protocol processor is programmed via on- 
chip microcode stored in a microcode storage unit 208. The protocol processor is 
microcode-based with specific instructions to accelerate IPSec header processing. 

The chip also includes various buffers 210 for storing packet data, security 
association information, status information, etc., as described further with reference to 
10 Fig. 3, below. For example, fixed-sized packet cells may be stored in payload or 
packet buffers, and context or security association buffers may be used to store, 
security association information for associated packets/cells. 

The output cells are then stored in an output FIFO 216, in order to write the 
packets back out to the system. The processed cells are reassembled into packets and 
1 5 sent off the chip by the output FIFO 216. 

Fig. 3 is a block diagram of a cryptography accelerator chip architecture in 
accordance with one embodiment of the present invention. The chip 300 includes an 
input FIFO 302 into which IP packets are read. From the input FIFO 302, packet 
header information is sent to a packet classifier unit 204 where a classification engine 

20 rapidly determines security association information required for processing the packet, 
such as encryption keys, data, etc. As described in further detail below, the 
classification engine performs lookups from databases stored in associated memory. 
The memory may be random access memory (RAM), for example, DRAM or 
SSRAM, in which case the chip includes a memory controller 308 to control the 

25 associated RAM. The associated memory may also be contact addressable memory 
(CAM), in which case the memory is connected 1 directly with the cryptography 
engines 316 and packet classifier 304, and a memory controller is unnecessary. The 
associated memory may be on or off chip memory. The security association 
information determined by the packet classifier unit 304 is sent to a packet distributor 

30 unit 306 via the chip's internal bus 305. 

The packet distributor unit 306 then : distributes the security association 
information (SA) received from the packet classifier unit 304 and the packet data via 
the internal bus 305 among a plurality of cryptography processing engines 316, in this 
case four, on the chip 200, for security processing. For example, the crypto engines 
35 may include "3DES-CBC/DES X" encryption/decryption "MD5/SHA1" 
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authentication/digital signature processing and compression/decompression 
processing. As noted above, the present architecture is independent of the types of 
cryptography processing performed, and a further discussion of the cryptography 
engines is beyond to scope of this disclosure. 

5 The packet distributor unit 306 includes a processor which controls the 

sequencing and processing of the packets according to microcode stored on the chip. 
The chip also includes various buffers associated with each cryptography engine 316. 
A packet buffer 312 is used for storing packet data between distribution and crypto 
processing. Also, in this embodiment, each crypto engine 316 has a pair of security 

10 association information (SA) buffers 314a, 314b associated with it. Two buffers per 
crypto engine are used so that one 314b, may hold the SA for a current packet (packet 
currently being processed) while the other 314a is being preloaded with the security 
association information for the next packet. A status buffer 310 may be used to store 
processing status information, such as errors, etc. 

15 Processed packet cells are reassembled into packets and sent off the chip by an 
output FIFO 318. The packet distributor 306 controls the output FIFO 318 to ensure 
that-pack^ordering4s-maintaine<L _ 



Packet Classifier 

The IPSec cryptography protocol specifies two levels of lookup: Policy 
20 (Security Policy Database (SPD) lookup) and Security Association (Security 
Association Database (SAD) lookup). The policy look-up is concerned with 
determining what needs to be done with various types of traffic, for example, 
determining what security algorithms need to be applied to a packet, without 
determining the details, e.g., the keys, .etc. The Security Association lookup provides 
25 the details, e.g., the keys, etc., needed to process the packet according to the policy 
identified by the policy lookup, The present invention provides chip architectures and 
methods capable of accomplishing this IPSec function at sustained multiple full 
duplex gigabit rates. 

As noted above, there are two major options for implementing a packet 
30 classification unit in accordance with the present invention: CAM based and RAM 
(DRAM/SSRAM) based. The classification engine provides support for general 
IPSec policy rule sets, including wild cards, overlapping rules, conflicting rules and 
conducts deterministic searches in a fixed number of clock cycles. In preferred 
embodiments, it may be implemented either as a fast DRAM/SSRAM lookup 
35 classification engine, or on-chip CAM memory for common situations, with 
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extensibility via off-chip CAM, DRAM or SSRAM. Engines in accordance with 
some embodiments of the present invention engine are capable of operating at 
wirespeed rates under any network load. In one embodiment, the classifier processes 
packets down to 64 bytes at OC12 full duplex rate* (1.2Gb/s throughput); this works 
5 out to a raw throughput of 2.5M packets per second. . . 

The classifier includes four different modes that allow all IPSec selector 
matching operations to be supported, as well as general purpose packet matching for 
packet filtering purposes, for fragment re-assembly purposes, and for site blocking 
purposes. The classifier is not intended to serve as a general-purpose backbone router 
10 prefix-matching engine^ As noted above, the classifier supports general IPSec 
policies, including rules with wildcards, ranges, and overlapping selectors. Matching 
does not require a linear search of overlapping rales, but instead occurs in a 
deterministic number of clock cycles. 

Security and filtering policies are typically specified using flexible rule sets 
15 that allow generic matching to be performed on a set of broad packet selector fields. 
Individual rules support wildcard specification and ranges for matching parameters. 
In addition, multiple rules are allowed to overlap, and order-based matching is used to 
select the first applicable rule in situations where multiple rules apply. 

Rule overlap and ordered matching add a level of complexity to hardware- 
20 based high-speed rule matching implementations. In particular, the requirement to 
select among multiple rules that match based on the order in which these rules are 
listed precludes direct implementation via high-speed lookup techniques that 
immediately find a matching rule independent of other possible matches- 
Chips in accordance with the present invention provide a solution to the 
25 problem of matching in a multiple overlapping order-sensitive rule set environment 
involving a combination of rule pre-processing followed by direct high-speed 
hardware matching, and supports the full generality of security policy specification 
languages. 

A pre-processing de-correlation step handles overlapping and possibly 
30 conflicting rule sets. This de-correlation algorithm produces a slightly larger 
equivalent rule set that involves zero intersection The new rule set is then 
implemented via high-speed hardware lookups. High performance algorithms that 
support incremental de-correlation are available in the art. Where CAM is used, a 
binarization step is used to convert range-based policies into mask-based lookups 
35 suitable for CAM arrays. 
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The function of, the packet classifier is to perform IPSec-specified lookup as 
well as IP packet fragmentation lookup. These lookups are used by the distributor 
engine, as well as by the packet input engine (FIFO). In one embodiment, 
classification occurs based on a flexible set of selectors as follows: 

5 . • Quintuple of <src IP addr, dst IP addr, src port, dst port, protocol> 

104 bits match field 

• Triple of <src IP addr, dst IP addr, IPSec SPI security parameter index> 
96-bit match field 

• Basic match based on <src IP addr, dst IP addr, protocol> 72-bit 
10 match field 

• Fragment match based on <src IP, dst IP, fragment ID, protocol> -> 
88-bit match field 

The result of packet classification is a classification tag. This structure holds 
IPSec security association data and per- flow statistics, 

15 As noted above, a classifier in accordance with the present invention can be 

implemented using several different memory arrays for rule storage; each method 
involves various cost/performance trade-offs. The main implementations are external 
CAM-based policy storage; on-chip CAM-based policy storage; and external RAM 
(DRAM, SGRAM, SSRAM) based storage. Note that RAM-based lookups can only 

20 match complete (i.e: exact) sets of selectors, and hence tend to require more memory 
and run slower than CAM-based approaches. On-chip CAM offers an attractive blend 
of good capacity, high performance and low cost. 

A preferred approach for cost-insensitive versions of a cryptography 
acceleration chip in accordance with the present invention is to implement an on-chip 
25 CAM and to provide a method to add more CAM storage externally. Rule sets tend to 
be relatively small (dozens of entries Tor a medium corporate site, a hundred entries 
for a large site, perhaps a thousand at most for a mega-site) since they need to be 
managed manually. The de-correlated rule sets will be somewhat larger, however 
even relatively small CAMs will suffice to hold the entire set. 

30 A preferred method for cost-sensitive versions of a cryptography acceleration 

chip in accordance with the present invention is to implement DRAM-based 
classification, with a dedicated narrow DRAM port to hold classification data (i.e. a 
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32-bit SGRAM device). A higher performance alternative is to use external SSRAM, 
in which case a shared memory system can readily sustain the required low latency. 

Both variants of packet classifier are described herein. The RAM-based 
variant, illustrated in Fig. 4 relies upon a classification entry structure in external 
5 memory. The RAM-based classifier operates via a hash-based lookup mechanism. 
RAM -based classification requires one table per type of match: one for DPSec 
quintuples, one for IPSec triples, and a small table for fragmentation lookups. 

An important property of DRAM-based matching is that only exact matches 
arc kept in the DRAM-based tables, i.e., it is not possible to directly match with 
| 10 wildcards and bit masks the way a CAM can. Host CPU assistance is required-to 

-j dynamically map IPSec policies into exact matches. This process occurs once every 

time a new connection is created. The first packet from such a connection will require 
the creation of an exact match based on the applicable IPSec policy entry. The host 
CPU load created by this process is small, and can be further reduced by providing 
15 microcode assistance. * 

The input match fields are hashed to form a table index, which is then used to 
look up a Hash Map table. The output of this table contains indexes into a 
j Classification Entry table that holds a copy of match fields plus additional match tag 

5 information. 

20 The Hash Map and Classification Entry, tables are typically stored in off-chip 

DRAM Since every access to these tables involves a time-consuming DRAM fetch, a 
fetch algorithm which minimizes the number of rehash accesses is desirable. In most 
typical scenarios, a matching tag is found with just two DRAM accesses with a chip in 

* accordance with the present invention. 

| • 

•; 25 To this effect, the hash table returns indexes to three entries that could match 

i in one DRAM access. The first entry is fetched from the Classification Table; if this 

matches the classification process completes. If not, the second then the third entry 
arc fetched and tested for a match against the original match field. If both fail to 
match, a rehash distance from the original hash map entry is applied to generate a new 
30 hash map entry, and the process repeated a second time. If this fails too, a host CPU 
interrupt indicating a match failure is generated. When this occurs, the host CPU will 
determine if there is indeed no match for the packet, or if there is a valid match that 
has noi yet been loaded into the classifier DRAM tables. This occurs the first time a 
packet from a new connection is encountered by the classification engine. 
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Because the hash table is split into a two-level structure, it is possible to 
maintain a sparse table for the top-level Hash Map entries. Doing so greatly reduces 
the chances of a hash collision, ensuring that in most cases the entire process will 
complete within two DRAM accesses. 

The following code shows the Hash Map table entries as well as the 
Classification Entries: 



10 



15 



20 



25 



/• 

* Security -Association Table - Classification Fields 

* Used to look up an association per header. 

* This table is accessed via a hash lookup structure, SATClassHaeh, 



defined next. 



* Note that a single IPSec Security Association Database entry can occupy multiple 

* SATClass entries due to wildcard and range support for various headier fields. 



typedef struct SATC1 assist ruct { 



u32 
u32 
u!6 
ul6 
u32 
u8 
U32 

} SATClaas; 



srcAddr ; 
datAddr; 
s report ; 
da t Port ; 
spi .- 

protocol ; 
tag. 



/* IP source address •/ 

/* IP destination address */ 

/*tcp source port */ 

/* TCP destination port */ 

/* Securicy Parameter Index */ 

/• Next level protocol */ 

/* Match tag •/ 



Hash table structure to look up an entry in the Security 
-As soc i a t-ion -Table-Class if ication- 



30 * Fields array. Each hash bucket holds up to three entries pointing 

* to aat_class values. 

* There are two hash table structures one for SPI -baaed lookup, 

* one for inner header lookup. 
* 

35 * Overflows are handled via software. The odds of an overflow are small 

■ average hash bucket occupancy is 0.S entries per bucket, 

* and an initial overflow is handled via a variable -distance rehash* 

* Host software can set the rehash distance per hash entry to minimize 

* overflow situations. An overflow would require 3 entries in the first 
40 * hash bucket, followed by 3 entries in the second re -hashed 

* bucket as well. This is very unlikely in practice. 

* Multiple matching SATClass entries need to searched sequentially. 

45 typedef struct SATClassHash_struct { ' 

/* Up. to three pointers (index) of SATClass entries */ 
SATClass ' *IndexO, *Indexl, * Index2 ,- 

U32 SATPresentrlO; /* 2 low order bits are U entries <0-3) */ 
/* '8 high order bits are rehash distance */ 

50 } SATClaasHash; 



the 



In one embodiment of the present invention, a Hash Map structure entry is 
128-bits long, and a Classification Entry is 192-bits long. This relatively compact 
representation enables huge numbers of simultaneous security associations to be 
55 supported in high-end systems, despite the fact that DRAM-based matching requires 
that only exact matches be stored in inemory. As an example, the DRAM usage for 
256K simultaneous sessions for IPSec quintuple matches is as follows; 
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Classification Entry memory: 24 Bytes * 256K -> 6.1 Mbytes of DRAM usage 
Hash Map memory: Sparse (0.5 entries per hash bucket avg), 2*16 Bytes * 256K 
8M Bytes 

Total DRAM usage for 256K simultaneous sessions is under 16 Mbytes; 256K 
5 sessions would be sufficient to cover a major high-tech metropolitan area, and is 
appropriate for super high-end concentrator systems. 

Since DRAM-based classification requires one table per type of match, the 
total memory usage is about double the above number, with a second table holding 
IPSec triple matches. This brings the total up to 32Mbytes, still very low considering 

| 10 the high-end target concentrator system cost. A third table is needed for 

\ fragmentation lookups, but this table is of minimal size. 

Another attractive solution is to use SSRAM to build a shared local memory 
system. Since SSRAM is well suited to the type of random accesses performed by 
RAM-based classification, performance remains high even if the same memory bank 
i 15 is used for holding both packet and classification data. 

i Further performance advances may be achieved using a CAM based 

\ classification engine in accordance with the present invention. The CAM based 

I classifier is conceptually much simpler than the DRAM based version. In one 

embodiment, it is composed of a 104-bit match field that returns a 32-bit match tag, 
j * ■ ■ ■ 

20 for a total data width of 136-bits. In contrast to DRAM-based classification, a 

common CAM array can readily be shared among different types of lookups. Thus a 

single CAM can implement all forms of lookup required by a cryptography 

acceleration chip in accordance with the present invention, including fragment 

\ lookups, IPSec quintuple matches, and IPSec triple matches. This is accomplished by 

\ 25 storing along with each entry, the type of match that it corresponds to via match type 

; field. 

Because the set of IPSec rules are pre-processed via a de-correlation step and a 
binarization step prior to mapping to CAM entries, it is not necessary for the CAM to 
support any form of ordered search. Rather, it is possible to implement a fully parallel 
30 search and return any match found. 

Referring to Fig. 5, the preferred implementation involves an on-chip CAM 
that is capable of holding 128 entries. Each entry consists of a match field of 106-bits 
(including a 2-bit match type code) and a match tag of 32-bits. An efficient, compact 
:] CAM implementation is desired in order to control die area. The CAM need not be 
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fast; one match every 25 clock cycles will prove amply sufficient to meet the 
performance objective of one lookup every 400ns. This allows a time-iterated search 
of CAM memory, and allows further partitioning of CAM contents into sub-blocks 
that can be iteratively searched. These techniques can be used to cut the die area 
required for the classifier CAM memory. 

CAM matching is done using a bit mask to reflect binarized range specifiers 
from the policy . rule set. In addition, bit masks are used to choose between EPSec 
quintuple, triple, fragment or non-IPSec basic matches. 

Should on-chip CAM capacity prove to be a limitation, an extension 
mechanism is provided to access a much larger off-chip CAM that supports bit masks. 
An example of such a device is Lara Technologies* LTI1710 8Kxl36/4Kx272 ternary 
CAM chip. 

Typical security policy rule sets range from a few entries to a hundred entries 
(medium corporate site) to a maximum of a thousand or so entries (giant corporate site 
with complex policies). These rule sets are manually managed and configured, which 
automatically limits their size. The built-i n CAM size should be sufficient to cover 
typical sues with moderately complex rule sets; off-chip CAM can be added to cover 
mcca-sitcs. 

CAM-based classification is extremely fast, and will easily provide the 
required level of performance. As such, the classifier unit does not need any 
pipelining, and can handle multiple classification requests sequentially. 

Figs. 6A and 6B provide process* flow diagrams showing aspects of the 
inbound and outbound packet processing procedures (including lookups) associated 
with packet classification in accordance with one embodiment of the present 
invention, Fig. 6A depicts the flow in the inbound direction (600). When an inbound 
packet is received by the packet classifier on a cryptography acceleration chip in 
accordance with the present invention, its header is parsed (602) and a SAD lookup is 
performed (604). Depending on the result of the SAD lookup and as specified by the 
resulting policy, the packet may be dropped (606), passed-through (608), or directed 
into the cryptography processing system. Once in the system, the packet is decrypted 
and authenticated (610), and decapsulated (612). Then, a SPD lookup is performed 
(614). If the result of the lookup is a policy that does not match that specified by the 
SAD lookup, the packet is dropped (616). Otherwise, a clear text packet is sent out of 
the cryptography system (618) and into the local system/network. 
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Fig. 6B depicts the flow in the outbound direction (650). When an outbound 
packet is received by the packet Classifier on a cryptography acceleration chip in 
accordance with the present invention, its header is parsed (652) and a SPD lookup is 
performed (654). Depending on the result of the SPD lookup and as specified by the 

5 resulting policy, the packet may be dropped (656), passed-through (658), or directed 
into the cryptography processing system. Once in the system, a SAD lookup is 
conducted (660). If no matching SAD entry is found (662) one is created (664) in the 
IPSec Security Association Database. The packet is encapsulated (666), encrypted 
and authenticated (668). The encrypted packet is then sent out of the system (670) to 

10 the external network (WAN). 

Examples 

The following examples describe and illustrate aspects and features of specific 
implementations in accordance with the present invention. It should be understood 
15 the following is representative only, and that the invention is not limited by the detail 
set forth in these examples. 

Example 1: Security Association Prefetch Buffer 

20 The purpose of the SA buffer prefetch unit is to hold up to eight Security 

Association Auxiliary structures, two per active processing engine. This corresponds 
to up to two packet processing requests per engine, required to support the double- 
buffered nature of each engine. The double buffered engine design enables header 
prefetch, thus hiding DRAM latency from the processing units, the structures are 

25 accessed by SA index, as generated by the packet classifier. 

Partial contents for the SA Auxiliary structure are as sfiown in the following C 
code fragment: 
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typedef struct SATAuxstruct { 

u32 bytecount; /* Total payload bytes processed via */ 

/* this entry (larger of crypto or auth bytes) */ 

5 u64 expiry; /* Expiry time or #bytes for this */ . 

/* entry (checked per use) */ 

u32 packetCount; /* Stats - tt packets processed via this entry ■/■ 

struct SATAux struct 'next; /* Next IPSec Security Association for SA */ 
" /• bundles */ 

10 u32 seqNoHi; /* Anti replay sequence number - "right" edge of window 



/* for outgoing packets, used' for next sequence number 



u64 seqWin; /* Anti -replay sequence window (bit mask) */ 

15 u32 peerAddr; /* IPSec peer security gateway address */ 

u32 spi'; /* IPSec security parameter index */ 

u8 originalProtocol ; /* pre -IPSec Protocol to which this SA applies */ 

cryptoState algoCrypto; /* Keys and other parameters for crypto •/ 
20 authstate algoAuth; /* Keys, state and other HMAC parameters •/ 



uB 


enableSeq : 1 ; 


/* 


u8 


Crypto : 2 ; 




u8 


auth: 2 ; 


/* 


u8 


format: 2; 


/* 


u8 


tunnel : 1; 


/• 


ue 


discard : 1 ; 


/• 


u8 


pass:l; 


/* 


u8 


intnl; 


/* 






/* 


u8 


explicitiv;l ; 


/• 




/• 


u8 


padnull :1; 


/• 






/• 


u8 


oldpad:!; 


A* 


SATAux ; 







Drop packet */ 

Pass packet through */ 

30 u8 intnl; /* Interrupt upon match to this entry »/ 

(useful for drop/pass) */ 

Use implicit IV. from SAdB as opposed to e 
IV from packet */ 

Apply pad to 64 -byte boundary for ESP */. 

35 r ^ null crypto upon IPSec output */ 

Old style random padding per RFC1829 */ 



The SA Buffer unit prefetches the security auxiliary entry corresponding to a 
40 given SA index. Given an SA index, the SA buffer checks to see if the SA Aux entry 
is already present; if so, an immediate SA Hit indication is returned to the distributor 
micro-engine. If not, the entry is pre-fetched, and a hit status is then returned. If all 
SA entries are dirty (i.e. have been previously written but not yet flushed back to 
external memory) and none of the entries is marked as retired, the SA Buffer unit 
45 stalls- This condition corresponds to all processing engines being busy anyway, such 
that the distributor is not the bottleneck in this case. 



Example 2: Distributor Microcode Overview 

In one implementation of the present invention, the distributor unit has a 
micro-engine large register file (128 entries by 32-bits), good microcode RAM size 

50 (128 entries by 96-bits), and a simple three stage pipeline design that is visible to the 
instruction set via register read delay slots and conditional branch delay slots. 
Microcode RAM is downloaded from the system port at power-up time, and is 
authenticated in order to achieve HPS 140-1 compliance. In order to ensure immediate 
micro-code response to hardware events, the micro-engine is started by an event- 

55 driven mechanism. A hardware prioritization unit automatically vectors the micro- 
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Packet issue Microcode: 

// - - 

// SA Buffer entry has been pre- fetched and is on-chip 

// Packet length is available on-chip 

// 

test drop/pass flags; if set special case processings- 
test lifetime; break if expired; // reset if auth fails later 
test byte count; break if expired; // reset if auth fails later 
assert stats update command; • // update outgoing sequence 

number 

assert locate next engine command; if none, stall; 

assert issue new packet command with descriptor ID, tag, length; 



retiring has priority over issue. 



Since the distributor unit is fully pipelined, the key challenge is to ensure that 
5 any given stage keeps up with the overall throughput goal of one packet every 50 

clock cycles. This challenge is especially important to the micro-engine, and limits the 
number of micro-instructions that can be expended to process a given packet. The 
following pseudo-code provides an overview of micro-code functionality both for 
packet issue and for packet retiring, and estimate the number of clock cycles spent in 
10 distributor micro-code. 



Packet Retiring Microcode: 



// SA Buffer entry has been pre -fetched and is on-chip 
// Packet length is available on-chip. Packet has been 
authenc icated 

// by now if authentication is enabled for this flow.. 
// 

if sequence check enabled for inbound, check & update sequence 
mask; 

update Engine scheduling status ; 

mark packet descriptor as free; add back to free pool; // Schedule 
write 



Since most distributor functions are directly handled via HW assist 
mechanisms, the distributor microcode is bounded and can complete quickly.. It is 
15 estimated that packet issue will require about 25 clocks, while packet retiring will 
require about 15 clocks, which fits within.the overall budget of 50 clocks. 

Example 3: Advanced Classification Engine (ACE) 
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In one specific implementation of the present invention, a classification engine 
(referred to as the Advanced Classification Engine (ACE)) provides an innovative 
solution to the difficult problem of implementing the entire set of complex IPSec 
specified Security Association Database and Security Policy Database rules in 
5 hardware. The IETF IPSec protocol provides packet classification via wildcard rules, 
overlapping rules and conflict resolution via total rule ordering. The challenge solved 
by ACE is to implement this functionality in wirespeed hardware. 

The Advanced Classification Engine of a chip in accordance with the present 
invention handles per-packet lookup based on header contents. This information then 

10 determines the type of IPSec processing that will be implemented for each packet. In 
effect, ACE functions as a complete hardware IPSec Security Association Database 
lookup engine. ACE supports full IPSec Security Association lookup flexibility, 
including overlapping rules, wildcards and complete ordering. Simultaneously, ACE 
provides extremely high hardware throughput. In addition, ACE provides value- 

1 5 added functions in the areas of statistics gathering and maintenance on a flexible per 
link or per Security Association basis, and SA lifetime monitoring. A separate unit 
within ACE, the Automatic Header Generator, deals with wirespeed creation of IPSec 



compliant headers. 



ACE derives its extremely high end to end performance (5 Mpkt/s at 125MHz) 
20 from its streamlined, multi-level optimized design. The most performance critical 

operations are handled via on-chip hardware and embedded SRAM memory. The next 
level is handled in hardware, but uses off-chip DRAM memory. The slowest, very 
infrequent frequent level of operations is left to host processor software. Key features 
of ACE include: 



| 25 • Full support for IPSec Security Association Database lookup, including 

\ wildcard rules, overlapping rules; and complete ordering of database entries. 

• Extremely high hardware throughput: Fully pipelined non-blocking 
out-of-order design. Four datagrams can be processed simultaneously and out of order 
to keep throughput at full rated wirespeed. 

30 • Flexible connection lookup based on src/dst address, src/dst ports, and 

protocol Any number of simultaneously active packet classification values can be 
supported. 

• Hardware support for header generation for IPSec Encapsulating 
Security Protocol (ESP) and for IPSec Authentication Header (AH). 
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• Full hardware header generation support for Security Association 
bundling - transport adjacency, and iterated tunneling. 

• Sequence number generation and checking on-chip.. 

• Classification engine and statistics mechanisms available to nbn-IPSec 
traffic as well as to IPSec traffic. 



• Security Association lifetime checking based on byte count and elapsed 
wall clock time. 

• High quality random number generator for input to cryptography and. ' 
authentication engines. 

10 The input to ACE consists of packet classification fields: src/dst address, 

src/dst ports, and protocol. The output of ACE is an IPSec Security Association 
matching entry, if one exists, for this classification information within the IPSec 
Security Association Database. The matching entry then provides statistics data and 
control information used by automatic IPSec header, generation. 

15 A global state flag controls the processing of packets for which no matching 

entry exists - silent discard, interrupt and queue up packet for software processing, or 
pass through. 

The matching table (SAT, Security Association Table) holds up to 16K entries 
in DRAM memory. These entries are set up via control software to reflect IPSec 
20 Security Association Database (SAdB) and Security Policy Database (SPdB) rules. 
The wildcard and overlapping but fully ordered entries of the SAdB and SPdB are 
used by control software to generate one non-overlapping match table entry for every 
combination that is active. This scheme requires software intervention only once per 
new match entry. 

25 Fig. 7. shows a block diagram of the ACE illustrating its structure and key 

elements. Major components of ACE are as follows: 



30 



Security Association Table Cache - Classification Field (SATC-CL): Used to look 
up a packet's classification fields on-chip; Each entry has the following fields: 



SATC-CL SA TC Classification Field Cache 


Field oame 


Description 


IPv6 

size 

(bits) 


IPv4 

size 

(bits) 
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src@ 


IP source address 


128 bits 


32 bits 


dst@ 


IP destination address 


128 bits 


32 bits 


protocol 


High level protocol field 


8 bits 


src port 


High level protocol source 
port. 


16 bits 


16 bits 


dst port 


High level protocol 
destination port 


16 bits 


16 bits 


Aux field 
ptr 


Pointer to auxiliary data (stats, 
lifetime) 


161 


bits 


peer@ 


IP address of IPSec peer 
gateway 


128 bits 


32 bits 


spi 


IPSec Security Parameter 
Index . 


321 


>its 


ipsec 
: format 


ESP, AH or none; Tunnel or 
Adj 


3 bits 



• . Security Association Auxiliary Data table Cache (SATC-AUX): Serves to hold 
statistics, etc. information on-chip in flexible fashion. An entry within SATC- 
5 AUX can serve multiple classification fields, allowing multiple combinations to 

be implemented for stats gathering. Each entry has the following fields: 



SATG-AUX-SATC Auxiliary Field Cache 


Field name 


Description 


IPv6 IPv4 
size size 
(bits) (bits) 








Byte count 


Total byte count for this entry 


32 bits 


Expiry time 


Time entry expires 


32 bits 


#misses 


SATC-CL misses for this entry 


32 bits 


#pkt 


Total packet count for this entry 


32 bits 


next_spi 


Next SPI for Iterated tunneling or 
Transport adjacency 


32 bits 


seqchk 


Enable anti-replay sequence 
check 


I bit 


seqno 


Sequence number (output) or 
highest received seq number 
(input) 


32 bits 


seqrnask 


Anti-Replay window 


64 bits 


algo_info 


Algorithm specific data (keys, 
pad lengths, Initial Vectors, etc) 


296 bits 



10 • Quad Refill Engine: handles the servicing of SATC-CL misses. When ever a miss 
occurs, the corresponding entry in the SATC-AUX is simultaneously fetched in 
order to maintain cache inclusion of all SATC-AUX entries within SATC-CL 
entries. This design simplifes and speeds up the cache hit logic considerably. The 
refill engine accepts and processes up to 4 outstanding miss requests 
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simultaneously. 

• Quad Header Buffers: Holds up to 4 complete IPv4 headers, and up to 256 bytes 
each of 4 IPv6 headers. Used to queue up headers that result in SATC-CL misses. 

5 Headers that result in a cache hit are immediately forwarded for IPSec header 

generation. 

• Header streaming buffer: Handles overflows from the header buffer by streaming 
header bytes directly from DRAM memory; it is expected that such overflows will 

10 be exceedingly rare. This buffer holds 256 bytes. : 

• Header/Trailer processing and buffer: For input datagrams; interprets and strips 
IPSec ESP or AH header. For output datagrams, adjusts and calculates header and 
trailer fields. Holds a complete IPv4 fragment header, and up to 256 bytes of an 

15 IPv6 header. Requires input from the cryptography modules for certain fields 

(authentication codes, for instance). 

In addition to the above components, two data structures in DRAM memory 
are used by ACE for efficient operation. These are: 

20 

• Complete Security Association Table- Classification Field (SAT-CL): holds 
classification data. This table backs up the on-chip SAT-CL Cache. Each entry is 
475 bits aligned up to 60 bytes. 

25 • Complete Security Association Auxiliary Data table (SAT-AUX): holds auxiliary 
data. This table backs up the on-chip SAT-AUX Cache. Each entry is 617 bits, 
plus up to 223 bits of algorithm specific state (such as HMAC intermediate state), 
for a total of 105 bytes. 
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The following pseudo-code module describes major ACE input processing 



Input Processing {) ( /* Received datagram */ 
Calculate bash value based upon 

(data, spi, protocol ) ; 
/* Re-hash via predetermined sequence if collision occurs */ 
Lookup field in Security Association Classification Cache; 
if (no match found) -{ 

/* Refill cache from DRAM memory */ 

Calculate new hash for DRAM entry; ■ 

/* Re -hash in case of collision**/ 

/* . 

* Out-of-order non-blocking execution 
•/ 

Schedule DRAM access (up to 4 outstanding fill req' s) ; 

Move on to Input Processing () of next datagram; 

/* When DRAM refill has completed */ 

Lookup .field in DRAM' Security Association table; 

Pre -fetch dram Auxiliary table entry; 

) • 
if (no match found) { 

/• 

* Datagram does not have a SAdB entry; 

* Process baaed on global flags* 
*/ 

if (nomatch_discard) silently drop packet ; 

else if (nomatchjp a33 > send insecure packet out; 

else queue up packet and raise interrupt; 

/• Datagram has a matching SAdB entry */ 
Sanity check packet header fields, including protocol; 
Verify packet data against SAdB entry; 
if (seqchk) Perforin ant i- replay check .- 
Perform lifetime check; 
Update— s tatist-i-c 9- infoxmat ion ; 



/* Aggressive writeback to minimize future miss latency */ 
Schedule SATC-AUX entry for writeback to DRAM; 
Extract SAdB processing control & crypto parameters; • 
Implement SAdB- specified processing on datagram; 

/• Double check packet SAdB match as" soon aa possible */ 
Perform SAdB lookup procedure on 

( arc® , dst® , srcport,dstport, protocol) ; 
Verify that original SPI is returned; 



(received datagrams) operation: 
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The following pseudo-code module describes major ACE output processing 



Output Processing () { /* Received datagram */ 
Calculate ha 3b value based upon 

(arc® . dst<» „ s report r dstport , protocol ) ; 
/• Re-hash via predetermined sequence if collision occurs */ 
Lookup field in Security Association Classification Cache ; 
if (no match found) { 

/* Refill cache from DRAM memory */ 

Calculate new hash for DRAM entry; 

/* Re-hash in case of collision */ 

/* 

* Out-of-order non-blocking execution 
*/ 

Schedule DRAM access (up to 4 outstanding fill req's) ; 
Move on to Input Processing O of next datagram; 
/* When DRAM refill has completed */ . , 

Lookup field in DRAM security Association table; 
Pre- fetch DRAM Auxiliary table entry ; 

if (no match found) { 
/* 

* Datagram does not have a SAdB entry; process based 

* Process baBed on global flags. 
V 

if (nomatch_discard) silently drop packet; 

else if (nomatch_pass) send insecure packet out; 

else queue up packet and raise interrupt ; 
i - 
/• Datagram has a matching SAdB entry */ 
Sanity check packet header fields, including protocol; 
Generate sequence number; 
Perform lifetime check; 
Update statistics information; 

/• Aggressive writeback to minimize future miss latency */ 
Schedule SATC-AUX entry for writeback to DRAM; 
extract SAdB processing control t crypto parameters.; 
Implement SAdB- specified -processing on datagram ; 



(transmitted datagrams) operation: 

ACE implements multiple techniques to accelerate processing. The design is 
fully pipelined, such that multiple headers are in different stages of ACE processing at 
any given lime, in addition, ACE implements non-blocking out-of-order processing of 
up to four packets. 

Out of order non-blocking header processing offers several efficiency and 
performance enhancing advantages. Performance-enhancing DRAM access techniques 
such as read combining and page hit combining are used to full benefit by issuing 
multiple requests at once to refill SATC-CL and SATC-AUX caches. Furthermore, 
this scheme avoids a problem similar to Head Of Line Blocking in older routers, and 
minimizes overall packet latency. 

Because of the pipelined design, throughput is gated by the slowest set of 

stages. 



Header parsing 



2 clocks 
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Hash & SA Cache lookup 2 clocks 

Hash & SA Auxiliary lookup 2 clocks 

Initial header processing, anti-replay 4 clocks 
Statistics update 3 clocks 

Final header update 6 clocks 

This works out to 19 clocks per datagram total with zero pipelining, within a 
design goal of 25 clocks per packet (corresponding to a sustained throughput of 
5Mpkt/s at 125MHz). A simple dual-stage pipeline structure is sufficient, and will 
provide margin (average throughput of 10 clocks per header). The chip implements 
this level of pipelining. 

ACE die area is estimated as follows based on major components and a rough 
allocation for control logic and additional data buffering: 



Control logic overhead 50Kg 
Quad header buffer 20Kg 
Quad refill controller with 50Kg 
tag match 

S ATC-CL cache 1 30Kg (single port) 
SATC-AUX-cache LZOKg_(single_port)_ 



Stats engine lOKg 

Header/Trailer processor 20Kg 

Prefetch buffering* 50Kg 

Total estimated gate count is 500Kg. 
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Conclusion 

Although the foregoing invention has been described in some detail for 
purposes of clarity of understanding, those skilled in the art will appreciate that 

5 various adaptations and modifications of the just-described preferred embodiments 
can be configured without departing from the scope and spirit of the invention. For 
example, other cryptography engines may be used, different system interface 
configurations may be used, or modifications may be made to the packet processing 
procedure. Moreover, the described processing distribution and classification engine 

to features of the present invention may be implemented together or independently. 
Therefore, the described embodiments should be taken as illustrative and not 
restrictive, and the invention should not be limited to the details given herein but 
should be defined by the following claims and their full scope of equivalents. 



J 15 What is claimed is: 



i 
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1 CLAIMS 

2 1 . A cryptography acceleration chip, comprising; 

3 a plurality of cryptography processing engines; and 

4 a packet distributor unit configured to receive data packets and matching 

5 classification information for the packets, and to input each of the packets to one of 

6 the plurality of cryptography processing engines; 

7 wherein the combination of said distributor unit and plurality of cryptography 
S engines is configured to provide for cryptographic processing of a plurality of the 
*> packets from a given packet flow in parallel while maintaining per flow packet order. 

io 2 The chip of claim 1, wherein said distributor unit processes received packet and 

U matching classification information sequentially. 

i: 3. The chip of claim 1, wherein said plurality of cryptography engines process the 

1} input packets in parallel. 

14 4. The chip of claim 1, wherein said distributor unit inputs packets to the 

15 cryptography engines in round-robin fashion. 

16 5. The chip of claim 4, wherein said distributor unit reads packets output from the 

17 cryptography engines in the same round-robin fashion. 

IS 6. The chip of claim 1, wherein the combination of said distributor unit and plurality 

i«j of cryptography engines is configured to provide for cryptographic processing of a 

20 plurality of the packets from a plurality of packet flows in parallel while maintaining 

jj 21 packet ordering across the plurality of flows. 

22 7. The chip of claim 1, wherein said packets require EPSec cryptography processing. 

23 8. The chip of claim 7, wherein said chip operates at sustained rate of at least one 
.. 24 Gigabit/s in full duplex mode. 

25 9. The chip of claim 1, wherein said distributor unit further comprises an order 

26 maintenance retirement unit configured to enable the plurality of cryptography engines 

27 to process incoming packets in out-of-order fashion. 

28 10. The chip of claim 9, wherein said order maintenance retirement unit extracts 

29 processed packets from a retirement buffer and outputs them from the chip in the 

30 same order in which they were received by the chip. 
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31 11. A method for accelerating cryptography processing of data packets, the method 

32 comprising: 

' 33 receiving a plurality of data packets on a cryptography acceleration chip; 

34 processing the data packets and matching classification information for the 

35 packets; 

36 distributing the data packets to a plurality of cryptography processing engines 

37 for cryptographic processing; 

38 cryptographically processing the data packets in parallel on the plurality of 
I 39 cryptography processing engines; 

40 outputting the cryptographically processed data packets from the chip in 

4 1 correct per flow packet order. 

42 12. The method of claim 11, wherein said processing of received packet and 
} 43 matching classification information is done sequentially. 

1 44 1 3, The method of claim 1 1 , wherein sai<3 cryptographic processing ofsaici packets on 

I 45 said plurality of cryptography engines is done in parallel. 

■] 46 14. The method of claim 1 1, wherein said distribution of packets to the cryptography 

47 engines is done in round-robin fashion. 

48 15. The method of claim 14, wherein said outputting of packets from the 

49 cryptography engines is done in the same round-robin fashion. 

| 50 16. The method of claim 11, wherein the combination of said distribution and 

j 51 cryptographic processing further maintains packet ordering across a plurality of flows. 

52 17. The method of claim 11, wherein said packets require IPSec cryptography 

53 processing. i 

54 18. The method of claim 17, wherein said chip operates at sustained rate of at least 

55 one Gigabit/s in full duplex mode. 

56 19. The method of claim 18» further comprising managing the processing of the 

57 packet data through the plurality of cryptography processing engines without requiring 

58 any attached local memory. 

59 20. An EPSec cryptography acceleration chip, comprising: 
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60 an external system bus interface unit; 

61 a packet classifier unit: 

62 a packet distributor unit; 

63 a FIFO input buffer connected to the packet classifier unit; 

64 a FIFO output buffer connected to packet distributor unit; . 

65 a plurality of cryptography processing engine units connected to the packet 

66 distributor unit; and 

67 a control processor that manages the processing of packets through the chip. 

1 21. The IPSec cryptography acceleration chip of Claim 20, further 

2 comprising; 

3 a packet splitting unit, in which incoming packets are split into fixed-sized 
1 4 cells. 

I 1 22. A network communication device, comprising: 

\ 2 a central processing unit; 

3 a system memory; 

.i _ 

4 a network interface unit; 

5 a cryptography acceleration chip comprising: 

I 6 a plurality of cryptography processing engines; and 

7 a packet distributor unit configured to receive data packets and 

] 8 matching classification information for the packets, and to input each of the 

9 packets to one of the plurality of cryptography processing engines; 

10 wherein the combination pf said distributor unit and plurality of 

1 1 cryptography engines is configured to provide for cryptographic processing of 

12 a plurality of the packets from a given packet flow in parallel while 

13 maintaining per flow packet order. 

14 an internal bus that connects the central processing unit, the system memory, 

1 5 the network interface unit, and the cryptography acceleration chip. 

: i - 33 - 
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16 23. The device of claim 22, wherein the internal bus is a high speed switching matrix. 
17 
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memory. In some embodiments, the 
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duplex Gigabit rate security processing 
of IPSec protocol data packets. 
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